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(54) Method and apparatus for controlling multivariable nonlinear processes 



(57) A method and apparatus for a robust process 
control system which utilizes a neural-network based 
multivariable inner-loop PD controller cascaded with de- 
coupled outer-loop controllers with integral action, the 
combination providing a multivariable nonlinear PI D and 
feedforward controller. The inner-loop PD controller em- 
ploys a quasi-Newton iterative feedback loop structure 
whereby the manipulated variables are computed in an 
iterative fashion as a function of the difference between 
the inner loop setpoint and the predicted controlled var- 
iable as advanced by the optimum prediction time, in 
order to incorporate the downstream limiting effects on 
the non-limited control loops. The outer-loop controllers 
compensate for unmodeled process changes, unmeas- 
ured disturbances, and modeling errors by adjusting the 
inner-loop target values. 
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Description 



miJ Jilhr n H IOn re ' ateS indUS,ria ' prOCeSS COntro,s ' more P artic "'^>y. for a method and apparatus for controllinq 
multivariate, dynamic, nonlinear industrial processes controlling 

ess Jst U o 1 ? e l r^! i0n T °°!l tinUa,,y StfiVed t0WardS atta ' nin9 the ° p,imum ™™»' ,or tolling industrial proc- 
esses in order to meet quality and production requirements. However, most modem industrial processes are comptex 
requinngmult.p.econtro, variables wim interacting dynamtes having^ 
such complex mdustnal processes, there have evolved various process control techniques 

Most current process control techniques determine the optimum operation of a process by monitoring one or more 
clllT 8 f CharaCter,S,icS 0ver time in order to adjust the operational parameters of the processTn ordTr to 
compute the optimum operational parameters, especially in light of variations in the setpoint system Snlics and 

me^ch^^ n ' qUeS ' ,hiS m ° del ' ° f P3rt ° f iS inCOrp ° ra,ed » m » a «' ar ^ructure. T*e aocura y of 
these techniques rel.es on a prease dynamic model of the process. Such a model may not be available 
processes have uncertainties which cannot be modeled precisely or simply. 8 ° me 

Recently, neural networks have become an attractive means for modeling complex processes This is because a 
neum, network has the inherent ability to approximate a murtKrariab.e nonlinear f unctbn TlTSiJiSSrS: 
advantageous s,nce rt does not require a complete or precise understanding of the process Rather t Sn acauife a 
represented of the process through its capacfty to be trained and to learn by example A neZ neSo* ha »e 
addmona. capability of handling delayed variables and, hence, represent dynamic systems 

The apphcation of neural networks in the process control area is a relatively recent development Nevertheless 

n!l , ^ ? n0n " near m ° del predictive contral Rework. Typically, these types of control systems 

m*Z£l:T? m9 ? n r Ura L ne,WOrk m ° del * ,he PrOCeSS ' to determine the manipuffed JS^SZ 
ap P r e d toTha setLl, a / 9et h Value - Process Redback is provided through a process-mode.-mismatch signal which is 
£ l ha Se,P °' n ,h f reb y c °™Pensat,ng for unmodeled disturbances. This mismatch signal is the difference be- 

The LTon 83 P , and 3 m0de " ed Pr0C6SS ° U,pUt 9enerated by a neural mooel of the process 

the Jffl nf , 3 neUra ' n9tW ° rk m ° del and a " °P timi2er - The neural "etwork model is used to predict 

a^ZtZ^ZT T Varbb ' e ,rajeC,0,y ° n the Pf0CeSS 0U,PU1S ° ver a futUfe ,ime trajectoTtakCnS 
account presen and recent past process input and output values. The optimizer uses this information to select values 

of ttje man.pu.ated variables such that the process outputs optima,* track the setpoint and satisfy ^en ^TZ 

rfk.,^"" 130 ' li ? ta, J° n ° f ,hiS ,ype °' pr0C6SS con,ro1 system is tnat ft *** n e« handle effectively unmeasured load 
JEST. 3 139 d ° m ' nant prOC6SS ArtnOU9h ,he use °< a niodel errorfeedback gives the systeTthe cTpaSS 

3 PUfe . me d0minant ,he meth0d 6068 not stebili2e a "°n^elf reguiZg or an'opS 

loop-unstable process unless some additional feedback is applied. There is no proportional or derivatte feedback 
only a quasi-integral feedback action provided through the process^odel-mismatch signeT ' 

tioni , l i S m , w ntK " 1 M eekS ,0 Pr ° Vide 3 r0bUSt and efficient process n*"™ which accounts for the above men- 

nont °T Part ' CU,arly ' ^ ° P,imal mul,ivariab 'e nonlinear control system which is robust accommcdatos 
Zfl? T? Pr0CeSSeS 38 We " 38 PUfe dead ,ime processes - compensates to prevent upsets by me^utd 
loads, and combats unmeasured disturbances with high feedback gain upsets oy measured 

A method and apparatus for a robust process control system that utilizes a neural-network-based controller oro 
v,d.ng .mproved control of mu.ttvariable, nonlinear, dynamic processes is herein disclosed P 
anZT r ZZt%T r °\ S T em m T 3 neura '-network-based con.rol.er as an inner-.oop multivariate proportional- 
oTnaffe i^Zl ] ■ r0 " er K CaSCaded With d6COUpled 0Uter - |0 °P strollers which provide integral actKe^om- 
tL Z proportio nal-and-in.egra.-and-derK,at^e (PID) and feLforwaScontrSer 
^Tts tne^nino^! PDcon.ro.ler is trained to achieve optimal performance when future process behavbr 

ZtoLTlZSZ^ k J" l0OP T ,r0 " erS C ° mpenSate fof Unmodeted process ranges, unmeasured 
Disturbances, and modeling errors by adjusting the inner-loop target values 

v»,b2!.T! r " l0OP P °j= ontrol,er empk> y s a q^asi-Newton iterative feedback loop structure whereby the manipulated 

predicted T T as afunctio " * *e deference between the inner loop" sSpofnt She 

1 , !k b 9 35 adVanC6d by ,he ° ptimum prediction «™- in order to incorporate the down^eam 

Itn if n w° n n ° n "" m,,ed COntr ° l IOOpS - 71118 con,ro1 system incurs an overhead for the on-.L iteS Iteu 
lat.on yet provdes more accurate contro. of the non-limited control loops wnen limrting occurs 

C on,IS 7 r n f embodimen,s of thi « Process control system. In the first and second embodiments the process 

controller. The mner-loop PD controller produces the change in the manipulated variable needed to place the process 
a. the desired se.pomt level based on measurements of the process and their derivatives. The innX PD c« 
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also produces the optimum prediction time of the process which is used by the outer-loop integral controllers in per- 
forming integral action. In the first control embodiment, the inner-loop PD controller and the outer-loop controllers 
simultaneously receive feedback from the process through controlled variables sampled at a specified measurement 
rate. In the second control embodiment, the inner-loop controller receives process feedback through inferential varia- 

s bles sampled at a faster measurement rate thereby providing a quick response to changes in the process. The integral 
controllers receive feedback through the controlled variables thereby providing integral action to adjust the setpoint to 
compensate for unmodeled errors, unmeasured disturbances, and the like. 

In the third and fourth embodiments, the control system consists of the PD feedforward controller solely without 
the outer-loop integral controllers. In the third embodiment, the controller receives process feedback through the con- 

10 trolled variables thereby responding to changes in the process at the measurement rate. In the fourth embodiment, 
the controller receives feedback through inferential variables thereby producing a faster control response to changes 
in the process. 

The foregoing and other features and advantages of the invention will be apparent from the following more particular 
description of the preferred embodiments of the invention, as illustrated in the accompanying drawings in which like 
is reference characters refer to the same elements throughout the different views. The drawings are schematic repre- 
sentations of control elements, emphasis being placed on illustrating the principles of the invention. 

FIG. 1 illustrates the first embodiment of the process control system wherein the inner-loop PD controller is cas- 
caded with outer-loop controllers which both receive process feedback through the controlled variables. 

FIG. 2. is a flow chart illustrating the steps in the constraint management scheme as used in the first and second 
20 embodiments of the process control system. 

FIG. 3 illustrates the second embodiment of the process control system wherein the inner-loop PD controller re- 
ceives process feedback through inferential measurements and is cascaded with outer-loop controllers that receive 
process feedback through the controlled variables. 

FIG. 4 illustrates the third embodiment of the process control system wherein the process control system consists 
25 of the PD controller solely without the outer-loop controllers and wherein the PD controller receives process feedback 
through the controlled variables. 

FIG. 5 illustrates the fourth embodiment of the process control system wherein the process control system consists 
of the PD controller solely without the outer-loop controllers and wherein the PD controller receives process feedback 
through the inferential variables. 
30 FIG. 6 illustrates the processing elements contained within the PD controller. 

FIG. 7 is a flow chart illustrating the processing steps used by the PD controller in computing the manipulated 
variables. 

FIG. 8 is a flow chart illustrating the processing steps used in the iteration initialization phase by the PD controller. 
FIG. 9 is a flow chart illustrating the processing steps used in the computation of the optimum prediction times and 
35 the predicted controlled variables by the PD controller. 

FIG. 10 is a flow chart illustrating the processing steps used in the computation of the manipulated variables by 
the PD controller. 

A method and apparatus for a robust process control system that utilizes a neural-network controller providing 
improved control of multivariate, nonlinear, dynamic processes is herein disclosed. 
40 Prior to describing the details of the invention, a brief synopsis of the signals used in the invention is presented first. 

t is an integer representing a particular time step of the process. 

r(t) outer-loop setpoint - the input signal which represents the target value of the process output at time step t. 

45 

r*(t) inner-loop setpoint - the input signal which has been adjusted by the outer-loop controller to compensate for 
unaccounted process dynamics, disturbances, and modeling errors. 

u(t) manipulated variable - a vector of signals which represents a quantity or condition which is varied at time step 
50 t as to change the value of the controlled variable. 

y(t) controlled variable - a vector of process output signals which represents the measured process output at time 
step t For the purposes of this application, the terms controlled variable and measured process output are used 
synonymously 

55 

/(t) derivative of the controlled variable - a vector of signals which represents the rate of change with respect to 
time of the measured process output at time step t. 
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w(t) inferential variable - a vector of process output signals which represents inferential values of the measured 
process output at time step t 

wV) derivative of the inferential variable - a vector of signals which represents the rate of change with respect to 
time of the inferential process output at time step I ~ 

v'(t) derivative of the measured load variable -a vector of signals which represents the rate of change with respect 
to time of the measured load signal at time step t 

A 

k(t) optimum prediction time - a vector of real numbers representing the relative time where the corresponding 
controlled vanable /s most sensitive to a change in its paired manipulated variable. For the purposes of this appli- 
catmn, the terms delay time, dead time, and optimum prediction time are used synonymously. 

y(t+k(t)) predicted controlled variable as advanced by the optimum prediction time - a vector of model output 
signab which predicts the measured process output or controlled variable at time step t advanced by the optimum 
prediction time, k(t), in terms of inputs and input derivatives at time step t. For the purposes of this application, the 
terms predrteo ^ controlled variable and predicted controlled variable as advanced by the optimum prediction time 
are used interchangeably. 

d(t) unmeasured bad disturbance - a vector of signals representing the disturbance caused by noise or load 
changes which is of an unmeasured quantity occumng at time step t. 

For the purposes of this application, when the above notations are used in the text and diagrams, they denote a 
vector of signals. For example, u(t) represents a vector of manipulated variable signals uJt) uJt) 

This enclosure presents a process control system encompassing a neural-network-based controller. The neural 

^nSii Can ™ TTt? ^* in ,he mamer 38 d6SCribed in the ,hW and ,ourth embodiments of copending 
appl.cat.on entrtled A Method and Apparatus for Providing Multivariate Nonlinear Control", and filed the same date 
herew,.h.cla.mingpr^ 

by reference and he reader .s specifically referred to the above-mentioned embodiments for a fuller understanding 
of the present disclosure. Protection may be sought in respect of features ol those embodiments 
anH 7. P"* ess control system utilees a neural-network-based controller as an inner-loop multivariate proportional- 
andKJer.vat.ve , (PD) controller cascaded with decoupled outer-loop controllers which provide integral action the com- 
binatrcn proving a multivariate nonlinear proportbnal-and-integral-and-derivative (PID) and feedforward controller 
The inner-loop neural-network PD controller is trained to achieve optimal performance when future process behaviour 
ZS1 a e * P *' ience - 1716 outer - |o °P ^rollers compensate for unmodeled process changes, unmeasured 

disturbances, and modeling errors by adjusting the inner-loop target values 

The inner-loop PD controller employs a quasi-Newton iterative feedback loop structure whereby the manipulated 
variables are computed ,n an iterative fashion as a function of the difference between the inner loop setpoint and the 
optimum predicted controlled variable, in orderto incorporate the downstream limiting effects on the non-limited control 
loops. The PD controller utilizes a neural network trained to output a predicted controlled variable and an optimum 
prediction time. The pred.cted controlled variable and the optimum prediction time are then used to determine the 
corresponding manipulated variable which will affect the process in the preferred manner. The optimum prediction time 
becomes he effect.ve response time of the predicted controlled variable to the setpoint where the greatest change in 
the predicted controlled variable occurs as a result of a small change made to its paired manipulated variable. The 
optimum prediction time represents the situation where the least manipulated variable change is required to place the 
future controlled variable at its target value or setpoint. If another time were used, the manipulated variable change 
would be larger result.ng .n an over correction and therefore oscillatory and possibly unstable behavior 

The predated controlled variable, y (t + k[t)), represents the measured process output as advanced by the optimum 
pred.ct.on time, t + k. It is then used to compute the corresponding paired manipulated variable which will affect the 
process causing rt to approach the desired setpoint. The computation of the manipulated variable is performed by an 
iterative high-gam feedback loop considering the effect of any limited manipulated variables on the non-limited manip- 
mated variables. r 

nr J? rt the I*' and , SeC ? d !™ bodiments ' the P^ 58 c °nt«>' system utilizes the combined multivariate nonlinear 
proportional-and-integral-and-dewatfve and feedforward controller. The inner-loop PD controller produces the change 
in the man.pufeted vanable needed to place the process at the desired setpoint level based on measurements of the 
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process and their derivatives. The inner-loop PD controller also produces the optimum prediction time of the process 
which is used by the outer-loop integral controllers in performing integral actbn. In the first control embodiment, the 
inner-loop PD controller and the outer-loop controllers simultaneously receive feedback from the process through con- 
trolled variables sampled at a specified measurement rate. In the second control embodiment, the inner-loop controller 

5 receives faster process feedback through inferential variables made at a faster measurement rate thereby providing 
a quick response to process changes. The integral controllers receive feedback through the controlled variables thereby 
providing integral action to adjust the setpoint to compensate for unmodeled errors, unmeasured disturbances, and 
the like. Integral windup is prevented through a constraint management scheme which stops the integrating action of 
the controller when limiting is detected in its downstream path. 

10 in the third and fourth embodiments, the control system consists of the PD controller solely without the outer-loop 

integral controllers. In the third embodiment, the controller receives process feedback through the controlled variables 
thereby responding to changes in the process at the measurement rate. In the fourth embodiment, the controller re- 
ceives feedback through-inferential variables thereby producing a faster-control response to changes in the process. 
FIG. 1 depicts the structure of the first process control embodiment. Referring to FIG. 1 , the process control struc- 

15 ture can be a PID controller consisting of outer-loop integral-type controllers, 10, cascaded with a PD controller, 12, 
cascaded with further controllers 14, downstream from the PID controller, which are coupled to a process 16. The 
downstream controllers 14 may include conventional control elements such as valves, actuators, and the like. The 
outer-loop controllers, 10, receive the outer-^oop setpoints, r(t), 18, the controlled variables fed back from the process, 
y(t), 38, and the optimum prediction times, k(\), 22, produced from PD controller 12. The outer-loop controllers adjust 

20 the outer-loop setpoints producing inner-loop setpoints r*(t), 24. Controllers 1 0 can be programmable general purpose 
CPUs or dedicated controllers such as The Foxboro Company's 760 Series Controllers. PD controller 12 can be im- 
plemented in software, to be run on a CPU, in hardware through electronic circuitry, or as a hybrid system, partially 
implemented in software and partially in hardware. 

The inner-loop PD controller, 12, can receive inner-loop setpoints, r*(t), 24, the controlled variables fed back from 

25 the process, y(t), 38, the derivatives, with respect to time, of the controlled variables, y'(t), 40, the measured load 
variables, v(t), 26, and the derivatives, with respect to time, of the measured load variables A v*(t), 28. The outputs of 
inner-loop controller 1 2 are manipulated variables, u(t), 30, and optimum prediction times, /c(t), 22. The manipulated 
variables can be transferred to downstream controllers 14 where they may be adjusted producing values 34 which are 
then transferred to process 16. 

so if the downstream controllers 14 limit any of the manipulated variables 30 (e.g. a fully open or closed valve), a 

logic signal, 20, indicating this limiting is produced from the downstream controllers and transmitted to a constraint 
processor 35. Constraint processor 35 responds to the limiting action in a number of ways selected through signal 33. 
The response to the limiting action is represented by signal 32 which is transmitted to the appropriate outer-loop con- 
troller. The process receives the change in the manipulated variable needed to place it at the desired setpoint level, 

35 1 8, and continues processing receiving measured load variables, 26, and unmeasured disturbances, d(t), 36. At the 
appropriate measurement rate, the controlled variable is measured and transferred to PD controller 12, and to outer- 
loop controllers 10. The function of these elements is described in more detail bebw. 

The outer-loop integral controller contains n outer-loop controllers, 10, (C v ..C n ), one for each pair of controlled 
and manipulated variables. The outer-loop controllers 10 adjust the inner-loop setpoints producing, ^(fy.^ft), 24. 

40 The outer-loop controllers can use as input^the outer-loop setpoints, 18, r(t), and the controlled variables, 38, y(t). 
Optionally, the optimum prediction times, 22, k(\), produced from PD controller 1 2, can be used to determine the integral 
time constants for the outer-loop integral controllers. The use of the optimum prediction time is advantageous since it 
automatically tunes the integral controllers to adapt to the dynamic conditions of the process without requiring manual 
intervention or adaptive tuning. 

45 The outer-loop controllers can employ pure integral action, PI action, or another type of integral action. For example, 

the PI action may be expressed mathematically for the i-th PI implementation as follows: 

r l (l) = x i (\) + .2[r i (i)-y i (\)] (1) 
where the integral term is represented by Xj(t). The integral term, Xj(t), may be calculated according to the following 
mathematical relations: 

so 

initialize: x^O) = y^O). (2) 

when downstream limiting occurs: 

XjO+IJ^XjWORXjm^XjO-l). (3) 

otherwise: 

55 x^t+1) = Xj (t) + (.3 * * (r-;(t) - Xj (t)). (4) 

For the case where the outer-loop controllers employ pure integral action only, the outer-loop integral action may 
be expressed mathematically for the i-th integral implementation as follows: 
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. „ »*« = f* (M) + [(r(t)-y(t)) * (1/(2 * k{t) - 1 ))]. (5) 

mitted to PD SS£ I?" 8 f ^ COntr0 " 8rS inneN0 ° P SetPOintS ' 24 ' f * (,) ' "«* are *" ^ 

PD controller 12 can receive inner-loop setpoints, 24, r*(t). as well as the measured load variables v(t) 26 the 
denvatives o the measured load variables, V(t), 28, the controlled variables, y(t), 38, and the derivatives of the con- 

f ,6edbaCk ° f aCtUa ' COntr °' measu ™™* makes the controller a feedforwa* 
proport^nal-and-denvatrve controller. PD controller 12 then determines the optimum manipulated variables u(t) 30 

oZ in^ P redlC ^°" tirnes ' W 22 - 109 °Ptimum P^iction times 22 can be etther transmitted to the outeMoop 

n^Tul^T^n COntr °, ,lerS U bS UtHiZed in thB COn,rol svs,em ad i us,in 9 ,he manipulated variables as 
Tount' 1 2T ^ COntr0 " er ° r the ^ream controllers set a manipufcted variable a. or beyond fts thresho.d 
amount, a og,c s gna. 20 ,s generated indicating the limited manipulated variable. Limiting occurs, for example, when 

»r™^l S , f 3 ^ iS ,Ully ° PSn 3nd Mnno1 "** ,ha demands ° f the ^rol.er. Logfc signal 20 is 
transmitted to constraint processor 35 which initiates a constraint signal 32 indicating a particular constrain? action to 
be employed by outer-loop controllers 10. The particular constraint action that is to be taEen can b.SSSS2 
outer-loop controller of the corresponding limited manipulated variable through constraint signal 32 
• I 0 ' n 2lllus,ra,es the s,e P s 1hat ^ be taken by constraint processor 35. Referring to FIG. 2, in step 45 the logic 
SetaTo^ 

iaeman Z^L I *? ! * 3m ° Un,) " ^ Si9n3 ' indiC3,eS limi,ina ' «"» of ,hree P° ssib '* constraint man- 

„ , ' PartiCU ' ar ° Pti0n iS Ch0S6n thf0U9h Si9nal 33 - The choicaof a P artic "'^ ^ion is 

tZTZl « rr TOT' 0 "- ,n the fifSt ° p,i ° n ' the assQcia,ed manipulated variable is flagged in sfep 51 
and ,n step 53 controller signal 32 can be set to temporarily freeze the integral action of the associated controller Fo 

IT™ 0 T m COntr0 " er Si9na ' 32 Ca " be USed ,0 set the setpoint of ,he associated «*«"«t rffl, equal to the 
m Z Z °' aS t ,n ,f ep . 55 - For exam P' e - if •*> is at fts upper limit, then for outer-loop controller = y ) 

rlem x r vTfo7 ho 32 US6d l ° reinftiaHZe the aSS0Ciat6d C0ntrO,ter,S ,n,e 9 ral te ™ * *• m-i 

" )- man,pulated varlables wer ° not limited, a further test can be made in step 47 to 

ateaThtimesS^^^ 

?se^v a tTnM h P T; ^' Ch Ca " te tranSmitted ,0 P ° C0ntrO " er 12 - PD con,ro,ler 12 - in turn, recomputes 
fjSSnt H m a"'P"'ated vanable, u(t), 30, for each paired controlled variable at each time step t which 

4 may be employed providing further conlrol action adjusting the manipulated variables producing values 34 Process 

encZIrino 34 hT?^ ° Pera,i0nal Pafame,erS aCC ° rdin9ly - ^ pr0C6SS procaeds in a conthtTus teThS 
encountering measured loads 26 and unmeasured disturbances 36 

e ff Inf 1°' ) he , in " er - |0 °P PD con,roller is to recompute values of the manipulated variables, considering the 
effect, ,f any, of the Hmrted control loops on the non-limited control loops, that will place the controlled variables at a 

ZtZZZZ £T 16 10 'I" ThS —P^- of the value's of the manipulated vanS es 

performed on-line by the ,nner-loop controller since limiting by the downstream controllers cannot be known in advance 

Scaurs CUfSa ^ 

diffpLn^ h j6 f W °! t thG inn ! r "'°° P COntr0 " er iS 10 03101,13,6 3 new va,ue for manipulated variable such that the 
the eZ s*TZ S P3,r f , COn, T" ed V3ri3b,e 3nd setpoint is zero - minimal. This difference is also referred to as 
SLTmSSi T T 'T thSSe manipulated vartab,es ™ b e made using the well-known quasi-Mewton 
TcTAPPUED^ATH^AT^rlh °' *" «* J - Hto ^ on « erative method can be found in INTRODUCTION 

JZT* f f CS by G " bert Stran9> Wellesle y-Cambridge Press, 1986.) This method starts out with an 

^SST"T "n**"^ variable and iteratively improves the approximate until the corresponding 

cclu SS» an aCCePtab ' e ,0 ' eranCe l6Vel - The ini,ia ' ^mation is the value of the manipulated variable 
computed from the previous operat.on of the controller. The improved approximation is based on the derive of the 

Zr^tw V3r,ab,e H W t i,h ; eSPeC, ,0 " S P3ired COn,r ° ,led V3ri3ble - ^ paired rolled variable is compld by a 
T t ° de, , ermine COn,r0 " ed V3ri3ble baS8d °" an V*™ P redic,i °" time and consLring he 

SSitS* r, T 3n ' pU,ated Vafiab,eS - The COntr0 " ed Varteble computed b V t^ neural network represents the 
STZSH, 3 6 me Whefe le3St manipulated variable cb ange is required to place the process ctose to 

libers* Z Z v apprOX ' m T S afe i,eratK ' eV C ° mpU,ed COnsiderin9 the effect of each manipulated variable on £ 
others, and converges when the corresponding error signal is minimized 

Th,s process can be performed by the PD controller through two nested iteration loops. The inner-loop iteration 
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computes the effect of each manipulated variable at time step t on all other manipulated variables at time step t. The 
inner loop is denoted by iteration variable i and iterates for each manipulated variable u r (t), for i = 1 to n. The outer- 
loop iteration controls the convergence of this process by controlling the number of times the inner loop iterates. The 
outer loop is denoted by the Iteration variable ii and can iterate for either a fixed number of iterations, ii=1 to nn, or until 
s each loop converges, which is defined when I r*(t) - y;(t) I < e, where e is a user-set tolerance. 

FIG. 6 illustrates the internal structure of PD controller 12. FIGS. 7-10 illustrate the steps that can be taken by 
PD controller 12. The slower loop consists of steps 50-52-54-56-58-60-62 and the faster loop consists of steps 
56-58-60-62. The notation used to illustrate the iterative process in FIGS. 7 through 10 is as follows: 

10 ii - denotes the current iterate of the slower loop, 

where ii = 1 to nn, 
i - denotes the current iterate of the faster loop, 

■ « -where i=1-to n, and - - - — 

j - is an index denoting a particular manipulated variable, controlled variable, or optimum prediction time where 1 
<= j <= n. 
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With reference to FIGS. 1 and 6, the PD controller can utilize a vector of n inner-loop setpoints, r*(t), 24; controlled 
variables, y(t), 38; the derivatives of the controlled variables, y'(t), 40; a vector of m measured load variables, v(t), 26; 
a vector of m derivatives of the measured load variables, v'(t), 28; and a vector of n manipulated variables. Initially, the 
20 manipulated variables can be the back calculated values, 46, from the downstream controllers which can be selected 
by closing switch 140. Otherwise, they can be the manipulated variables previously computed by the PD controller 
which are stored in the memory associated with CPU 166. Logic signal, 20, which indicates downstream limiting can 
also be used as well. 

The controller can proceed at time step t, step 50 in FIG. 7, with CPU 166 performing iteration initialization, step 
25 52 in FIG. 7. Referring to FIGS. 7 and 8, CPU 166 first determines, step 64 in FIG. 8, whether it is to perform initialization 
for the first time step of the process, or for any other subsequent iteration. For the first iteration, the manipulated 
variables can be initialized, step 66 in FIG. 8, in accordance with the following mathematical relation: 

u j0 (t) = 0 

= or any other user-defined value, (6) 
and the inner-loop setpoints are initialized, step 72 in FIG. 8, in accordance with the following mathematical relation: 

r*. fi (t) = r* (t), for ii=1 to nn, and i = 1 to n. (7) 
For ail subsequent iterations, the manipulated variables are initialized to the value of the last iteration of the preceding 
time step. The vector of manipulated variables from the last iteration, nn, of the preceding time step, t-1, is obtained 
3 5 from the memory of CPU 166, step 68 of FIG. 8. These manipulated variables can then be set, step 70 of FIG. 8, in 
accordance with the following mathematical relation: 

V^W 1 " 1 )" (8) 
Referring to FIGS. 6 and 7, CPU 166 can execute the slower loop iteration, step 54 of FIG. 7. Initially, the ii-iterate 
can be set to 1 , and otherwise incremented by one. Next, CPU 1 66 can execute the faster loop whereby the i-iterate 

40 index is initially set to 1 , and otherwise incremented by one. Neural network 1 52 then proceeds to compute the optimum 
prediction times and the predicted controlled variables, step 58 of FIG 7. 

Referring to FIGS. 6 and 9, in order for neural network 152 to compute the optimum prediction times and the 
predicted controlled variables, CPU 166 transmits a set of values of the manipulated variable signals to neural network 
1 52 which are stored in its memory. The memory associated with CPU 166 can store the current values of the manip- 

45 ulated variables. To initialize at time step 0, the values of the manipulated variables from the downstream controllers 
are the current values of the manipulated variables stored in the memory of CPU 166. At the start of the first iteration 
for each time step, t> 0, the values of the manipulated variables from the previous operation of the PD controller at 
time step t-1 are the current values stored in the memory of CPU 1 66. During the on-going operation of the PD controller, 
the current values of the manipulated variables are those computed at the present i,ii-th iteration and are stored in the 

50 memory of CPU 166. At each operation of the neural network at the i,ii-th iteration , CPU 1 66 transmits a set of values 
of the manipulated variables based on the current values stored in its memory. The values of the manipulated variables 
transmitted to neural network 152 can be as follows: 

Uj jM (t) for j >= i, 80a, those manipulated variables which have not been through iteration i,ii and, therefore, use the 

value of the ii-1 th iteration, and (9) 
Uj "(t) for j < i, 80b, those manipulated variables which 

have been through iteration i,ii and, therefore, use the value of the ii-th iteration. (10) 
In addition to manipulated variable inputs 80a and 80b, neural network 152 can also receive as inputs a vector of 
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IJJJ^^JJJ y(t) " , 38; a V f or of n derivatives ° f the trolled variables. 40; a vector of m measured-load 
variables, v(t). 26, anda vector of mderivatives of the measured-load variables, V(t), 28. Neural network 152 determines 

5 riS,^! m If , P : e of 6d COn,r0 ' led V3riableS - The °P timum P rediction «me that corresponds to the 

m iTSS? vana f ■ V- 88 * where 1=11 can be stored in memory 156 - 7116 «*■' °p timum p redict ^ £ 

Srrfet^l h T ? \"* ""^ and be The P** «*«*d arable hi 

37™™ ;i^ m T U,at ^ Variable ' + H. A is transmuted to summation circuit 120 and 

S^TZSI r p contro,led variables ' + ,or j>i - 90b - and ^ + w *»* 

10 trolled U v^ n a nHf 1 ? T PUteS err ° r Si9na ' 6i - H(,) ' 10 °' 33 the difference between ,he predicted con- 
trolled variable and its setpo.nt in accordance with the following mathematical relation: 

e i.B(t) = r*r,ii(t)- y Mi {t+ ^ jiM (t)). 

° f . Se ! P ^ im r * Mi(0 ' fe ^° r&i in the mem0ry ° f CPU 166 «« is transmitted to summation circuit 120 

' S m oo ttr 6 T ,? naL ^ COmP ' eti0n °' thS C ° mpUtati0n 0f the e ™ si 9" al *» the i,ii-th iteratbn, " 
(t), 100, the value is stored in the memory of CPU 1 66. • 

inrrZlnT 55 ""^f^ by ""^B the i.ii-th value of the manipulated variable. This can be accomplished by 
increasing the previously computed value, u^ft), by an increment representing the ratio of a small change to the 

cUam^ZZ^clVTT™* th T e h Sensrtivi * of a sma " manipulated variable to the resuming 

change in its predicted controlled variable. This sensitivity can be expressed mathematically as the ratio or stope 

g, = Au. M (t)/ A y. B (t + k,(t)), where (1 2) 

's any arbitrary input change to u, s and 
25 Ay, j(t + kj(t)) is the resultant change to y\ H (t) as a result of Au- -ft) 

and g f can be approximated as ''" 

A 9i = t u i*i(t)- A V 2 (t)]/ 

[>i,i-i (t + *ijM W) - y m (x + v, 2 (t))]. (1 3) 

30 slnS'n' W '" be 35 in eqUati0n 02) f ° r at least the first two ftera,ions ' and thereafter as in equation (13) 

k ,T PU, 1 S 9 Uti ' iZin9 Va ' UeS ° f ,he man * )ulated variabla and its Pa^ed optimum 

pmftged conjo lied vanabta fwn the previous two iterations which are stored in memory 162: Uj P l( t), 168, I , 2 (t) 
170. y i>H . l( t + ^ l( t)), 163. M + 165 . step 106 in FIG. 10. Next sensitivity processor 164 calcui the 

increment Su^t). 128, by multiplying the error signal e H (t) by the slope g, as in step 108 of f!g 10 
35 r ~ n , M ,ncreme "t. 5 "i,5(t). is calculated the i.ii-th manipulated variable is determined. Summation circuit 1 30 
recomputes the value of the ,,,i-th manipulated variable by incrementing the value of the i-th manipulated van4blefom 
the previous rteration, u l>M (t) by the increment, 8u Wi (t). step 112 in FIG. 10. This is expressed mathemaZITy as 

u i.ii( , ) = u i. S -i(t) + 5Ui ir (t). (14 ) 
The M'-th value of the manipulated variable, u^t), 168. is obtained from memory 162. step 110 in FIG 10 The 
<o recomputed ,,,-th value of the manipulated variable, Uj . is limited by limiter 134, step 114 in FIG 10 Jnecessarv to 
prevent the manipulated variable from exceeding rts threshold. The final value of the iji-th manipulated vaSbSen 
stored in memory 162 for use in subsequent iterations, step 116 in FIG 10 an.pu.aieo vanable is then 

This process continues for n i-rterations and then proceeds for each ii-th iteration until the convergence criteria is 

TINTS'* T^* Uf>0n * he COmP ' eti0n ° f th ° final ^ £ZSZ va ues o 

45 If »hTl P TZ !' Xt Ca " be transmWed downstream to other controllers and/or to the process The values 

m ZXZT. , t ? ,h0Se 3{ the ,aSt iMh iteration *** «" be sto red injhe memory of CPU 

J£Z IT T ranSm 9d UP ° n ClOSin9 SWitch 1 42 - Similar| y- the °P timum P redic,i °" times. Ml). 22, can be trans 

Strati ^ COn,r °" erS *" n S " tCh 158 " CtoSed The Va ' Ues transmi,ted are those computed T^t 

50 v ari i! mi ! 6r 1 34 limi, !- the UMh Va ' Ue ° f ,he mani P ulat e° variable, Uj (t), if necessary, in order to prevent the manipulated 
variable from ^exceed.ng rts threshold. The limiter can function in two ways. In the preferred maLr the lim3ceS 
logic signal 20 and back calculated values of the manipulated variables 46 selected by closing switch i TJogfc swlch 

fj^ZT ' 3 ^T 1316 ' Vari8ble ^ b6en ,imrt6d bV ,he downstream controllers and, rf so vvhether S 
exceeds^ rts upperor lower bound. Then the manipulated variable issetto the back calculated vaue 46 Alternattet 
£S the l,m.ted manipulated variable can be set to a user-defined value inputted through signal 48 Altematlve| y. 

» T mt ^ 0< ^ e firSt COn,r ° l embodimen t will be described below. Referring to FIG. 1 , at selected time intervals 
2*;^ 38 and m easured M variab|es 26 can be ^ q( ' appr^riaSumen. 

tation and transmmed back to PD controller 12 and outer-loop controller 10 simuteneously Typically, the measured 
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properties of the process may include the flow rate, pressure, temperature, or fluid chemical composition. The deriv- 
atives of these signals can be obtained either from measurements through appropriate instrumentation or from com- 
putations by a processing element. These derivative signals can be transmitted to PD controller 12. The controller 
responds quickly to its input signals producing manipulated variables 30 and optimum prediction times 22. Initially, the 

s adjusted setpoint, r*(t), 24, can be set equal to the setpoint, r(t). Manipulated variables 30 are transmitted to downstream 
controllers 14. Meanwhile, the outer-loop controllers 10 perform the slower integral control action producing adjusted 
setpoints 24 which can be used by PD controller 12 at the next control interval. Downstream controllers 14 employ 
further control action producing adjustments to the manipulated variables 30 which can be utilized by the process. If 
a manipulated or downstream variable is limited, a signal, 20, indicating the limiting action can be transmitted to con- 

10 straint processor 35. The constraint processor determines the appropriate constraint action and transmits this action 
through constraint signal 32 to the appropriate outer-loop controller. The entire process is then repeated at the next 
measurement interval. 

FIG. 3 illustrates the second process control embodiment. Referring to FIGS. 3 and 6,-the physical structure of 
the second control embodiment is similar to the first embodiment. The process control structure employs a PID controller 

is consisting of outer-loop integral-type controllers, 1 0, cascaded with a PD controller, 1 2, cascaded with further controllers 
14, downstream from the controller, which are coupled to a process 16. The outer-loop controllers receive process 
feedback through the controlled variables, y(t), 38, which are measured at selected time intervals. 

The difference is in the process measurement that is fed back to inner-toop controller 12. Inner-loop controller 12 
receives process feedback through inferential variables, w(t), 42, selected through switch 41, their derivatives, w*(t), 

20 44 t selected through switch 43, measured load variables, v(t), 26, and their derivatives, v"(t), 28, which are measured 
at a shorter time interval than of the controlled variables. Inferential variables are inferred approximations of the value 
of the controlled variables. They are typically continuous measurements made without detailed analysis. For example, 
in a distillation column, the controlled variable may be the chemical composition of the mixture and the inferential 
measurement may be the tray temperature from which the chemical composition may be inferred. The tray temperature 

25 is sampled continuously whereas the controlled variable is sampled at infrequent intervals requiring elaborate analysis. 
The use of the inferential variables by the inner-loop controller causes the process to operate at a faster control rate 
than the integral controllers, -thereby providing a quicker response to changes to the process. 

The operation of the second embodiment will be described below. Inferential variables, w(t), 42, are sensed or 
measured through appropriate instrumentation at a faster sampling rate and transmitted to innerJcop controller 12. 

30 The derivatives of the inferential variables, w*(t), 44, can be obtained either from measurements through appropriate 
instrumentation or from computations by a processing element and are transmitted to inner-loop controller 12. The 
measured load variables, v(t), 26, and their derivatives, v*(t), 28, are also sampled at the same faster sampling rate 
and are transmitted to inner-loop controller 12 as well. The inner-bop controller then computes manipulated variables 
30 which are transmitted downstream for use in affecting the process, and optimum prediction times 22 are transmitted 

35 to outer-loop controllers 1 0. The inner-loop controller operates continuously in this fashion utilizing the values of the 
adjusted setpoints r*(t), 24, which were last computed by the outer-loop controllers. 

Simultaneously at selected measurement intervals, controlled variables 38 can be sensed or measured through 
appropriate instrumentation and transmitted back to outer-loop controllers 10. These measurements are made at a 
slower sampling rate than that of the inferential variables. The outer-loop controllers also use the last values of the 

40 optimum prediction times, 22, which were transmitted from the inner-loop controller. The outer-loop controllers perform 
an integral control action using the optimum prediction times to determine the integral time constants, and produce 
adjusted setpoints, 24. These adjusted setpoints are then transmitted to the inner-loop controller. 

FIG. 4 illustrates the third process control embodiment which provides only PD control action performed by con- 
troller 12. This type of control system is simpler and advantageous for processes that do not need integral control 

45 action. Referring to FIG. 4, this control system consists of PD controller 12, cascaded to downstream controllers 14, 
which are coupled to process 16. PD controller 12 receives measured load variables, v(t), 26, their derivatives, v'(t), 
28, the outer-loop setpoints, r(t), 18, controlled variables, 38, and their derivatives, y'(t), 40. PD controller 1 2 performs 
a PD control action producing manipulated variables, u(t), 30 and the optimum prediction times, 22. Manipulated var- 
iables 30 can then be transmitted to downstream controllers, 14. The downstream controllers, 14, utilize the manipu- 

50 lated variables in their operation producing values, 30, which are used by the process to place it at the desired setpoints. 
The process proceeds in a continuous manner encountering measured load variables, v(t), 26, and unmeasured dis- 
turbances, d(t), 36. At selected time intervals, the controlled variables are measured or sensed through appropriate 
instrumentation and fed back to PD controller 12. Thus, the process control structure of this embodiment is that of a 
feedforward proportional-and-derivative controller. 

55 FIG. 5 illustrates the fourth embodiment of the process control system. Referring to FIG. 5, this embodiment has 

the identical control structure as in the third embodiment. It employs PD controller, 12, used to produce manipulated 
variables, 30, which can be transmitted to downstream controllers, 14, which therein produce values, 34, which will 
adjust the process, 1 6, to place it at the desired setpoints. The difference lies in the process feedback that PD controller 
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Jm ^' T, er "^° P u, COn,r0 " er reC6iVeS f6edback thrOU 9 h in,erential varables - 42. their derivatives, 
WJft 44, measured bad variables. v(t), 26, and their derives, V(t), 28, which are sensed or measured through 
approbate instrumental at a shorter interval than that of the controlled variables. This faster feedback gives the 
controller in this embodiment the ability to respond quickly to process changes 

The operation of the fourth embodiment will be described below. Inferential variables, w(t), 42, are sensed or 
measured through appropriate instrumentation at a faster sampling rate and transmitted to inner-loop controller 12 
The derivatives of the inferential variables, W(t). 44, can be obtained either from measurements through appropriate 
instrumentation or from computations by a processing element and are transmitted to inner-loop controller 12 The 

»n«ZTJ^ £T • ?" 26 ' th8ir d6riVatiVeS ' nX) ' 2B - are als0 at the same ^mpling rate 

« II ZT JTJ?** COntr0 " er 1 2 38 W6lL The inner ' l00p con,ro,,er com P«* s manipulated variables, 
30 wh ch are transmitted downstream for use in affecting the process. The inner-loop controller operates continuously 
in this fashion utilizing the values of the setpoint r(t), 18. «muouwy 

This disclosure presents a robust process control system utilizing neural-network-based PD controller for control- 
ling multivariate, nonlinear, dynamic processes. 

The preferred embodiments of this process control system have several advantages. First, they are effective at 
handling unmeasured load disturbances which makes them robust accommodating pure dead-time processes as well 
as non-self-regulat.ng processes. This is because there is direct proportbnal and derivative feedback to the controller 
from the process. Furthermore, actual control measurements are fed back to the PD controller instead of predicted 
values. This makes the overall process control system more effective at compensating to prevent upsets and combating 
unmeasured disturbances with feedback gain. s 

v^i^oTJ'i'J 8 in ? e ?'°° P ^° n,r0 " er r6CeiVeS inde P endent in P u,s for proportional terms, namely, the controlled 
var ables or inferential variables, the inner-loop setpoints, and the measured toad variables, and independent inputs 
for the derivative terms, namely, the derivatives of the controlled and measured load variables. These inputs give the 
controller, ,n essence different proportional and derivative gains for each of these terms, thereby making the controller 
able o respond quckly and accurately to both changes in the setpoint and measured load disturbances without over- 
shooting the response. 

Additionally, the use of the inferential variables gives the inner-loop controller the capability of quickly responding 

assures that the process will not oscillate or overshoot but rather exhibit stable control. The use of the optimum pre- 
diction time in determining the time constant used by the outer-loop controllers is advantageous since it automatically 

lTn«!l e , ' 9F r T r ° ,lerS 'I^P 1 10 th8 prOCeSS " S dynamiC COnditions without r ^ uirin 9 manual intervention or 
adapt.ve tuning. Furthermore, this control system incurs an overhead for the on-line iterative calculation yet provides 

more accurate control of the non-limited control loops when limiting occurs 

.w!,™ 6 , Vari °H S embodiments of tnis P^ 85 contr °' astern are flexible permitting variations from the preferred em- 

b™* 2 h?' T VamUS ,yPeS ° f Pr0C6SSeS - F ° r eXample ' for P rocesses - ,he ^tive action may not 
be war anted In such cases, the derivatives of the controlled variables and the measured load variables may be 
eliminated. This may be desirable for a dominant dead-time process or a process with large measurement noise 

It should be further noted that in all of the aforementioned embodiment, the function of the neural network need 
not be performed by a neural network. The functton of the neural network can be embodied in other types of data 
processmgstructures. Examples of such structures are, but notlimited to. nonlinear functton generator or characterizer 

SiS 9 ^ 658 ' too , k - u P, ,able ' in,erential «°9ic machine, or by a processor utilizing a set of equations which would 
calculate the appropriate values for the signals generated. 

em nh ,h0U9 ,!! ^ apreferred embodiments of the invention have been described hereinabove in detail, it is desired to 
emphasize that this is for the purpose of illustrating the invention and thereby to enable those skilled in this art to adapt 
the invention to various different applications requiring modifications to the apparatus described hereinabove- thus 
the spec.f,c details of the disclosures herein are not intended to be necessary limitations on the scope of the present 



Claims 



A method for controlling a process having process inputs, and process outputs including at least one controlled 
vanab e. an actuator for affecting the process, and at least one manipulated variable for use by the actuator to 
affect the controlled variable in relation to a setpoint, the method comprising the steps of: 

a) obtaining a set of manipulated variables; 

b) selecting a first manipulated variable from the set of manipulated variables- 

c) computing a predicted controlled variable corresponding to said first manipulated variable as a function of 
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the process inputs, particularly manipulated variables, and outputs, particularly controlled variables, said pre- 
dicted controlled variable representing the process output as advanced by an optimum prediction time, said 
optimum prediction time representing the effective response time of the controlled variable to the setpoint; 

d) determining the sensitivity of a change in the values of the first manipulated variable to a change in the 
values of the corresponding predicted controlled variable; 

e) determining the difference of the predicted controlled variable and the setpoint corresponding to the first 
manipulated variable; 

f) incrementing the value of the first manipulated variable in relation to the sensitivity and the difference; 

g) testing a signal representative of said difference against a predetermined tolerance level and determining 
if a predetermined condition is satisfied. 

2. A method as in claim 1 wherein the step of incrementing the value of the first manipulated variable includes the 
step of generating a partial derivative of the first manipulated variable with respect to the corresponding predicted 
controlled variable to determine a change signal for incrementing the value. 

3. A method as in claim 1 wherein said computation step further includes the step of determining process outputs 
representative of derivatives, with respect to time, of the controlled variables. 

4. A method as in claim 1 wherein said computation step further includes the step of collecting process inputs rep- 
resentative of measured load disturbances. 

5. A method as in claim 1 wherein said computing step is performed by a nonlinear function generator adapted to 
determine the optimum prediction time and said predicted controlled variable as a function of historical values of 
the process inputs and outputs. 

6. A method as in claim 1 wherein said incrementing step includes the step of limiting the first manipulated variable 
to prevent the value from exceeding predetermined limits. 

7. A method as in claim 1 wherein said step of testing includes testing said predetermined condition to determine 
when the difference between the setpoint and the predicted controlled variable for each manipulated variable is 
within a predetermined tolerance. 

8. A method as in claim 1 wherein said predetermined condition is a finite number of iterations. 

9. A method as in claim 1 wherein said computation step further generates the optimum prediction time for further 
control processing. 

10. A system for controlling a process responsive to a manipulated variable for affecting the process as a function of 
a controlled variable to place the process at a desired setpoint, said system comprising: 

a) means for retrieving a set of current values of the manipulated variables; 

b) a selector element for choosing a selected manipulated variable from the set of current values of the manip- 
ulated variables; 

c) a nonlinear function generator for generating a predicted controlled variable as advanced by an optimum 
prediction time, the optimum prediction time substantially representing the effective response time of the con- 
trolled variable to the setpoint; 

d) a sensitivity processor element for determining the sensitivity of a change in values of the selected manip- 
ulated variable to changes in the corresponding predicted controlled variable; 

e) a first computation means for determining the difference between the predicted controlled variable and the 
setpoint corresponding to the selected manipulated variable; 

f) a second computation means for recomputing the value of the selected manipulated variable as a function 
of said difference, said sensitivity, and said current value; 

g) a limiter element for preventing the selected manipulated variable from exceeding predetermined limits; and 

h) a processing element for operating said system for all values of the manipulated variable and for completing 
the operation of said system when a predetermined condition is satisfied. 

11. A system as in claim 1 or 10 wherein said nonlinear function generator is selected from a neural network, fuzzy 
logic processor, loop-up table, or inferential logic machine. 
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2. A system as in claim 10 wherein said nonlinear function generator operates with inputs comprising the current 
values of the manipulated variables and controlled variables representing a measured process output, or with 
inputs representative of derivatives, with respect to time, of the controlled variables, or inputs representative of 
measured load variables representing measured load disturbances, or derivatives, with respect to time, of the 
measured load variables. 

3. A system as in claim 10 wherein said nonlinear function generator is adapted to operate with inferential variables 
representing an indication of the controlled variables, or derivatives, with respect to time, of the inferential variables. 

4. A system as in claim 24 wherein said nonlinear function generator operates with inputs further comprising measured 
load variables representing measured load disturbances, or derivatives, with respect to time, of the measured load 
variables. 

5. A system as in claim 10 wherein said nonlinear function generator generates the optimum prediction time for use 
in further control processing. 

>. A system as in claim 10 wherein said nonlinear function generator is an adaptable processor element trained to 
compute the predicted controlled variable as advanced by the optimum prediction time on historical values of 
process inputs and process outputs. 

\ A system as in claim 10 wherein said processor includes memory means for storing a predetermined condition 
representative of a difference between the setpoint and the predicted controlled variable for the manipulated var- 
iable. 

I. A system as in claim 10 further including a counter element adapted to generate a predetermined condition signal 
representative of a finite number of iterations. 
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